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Abstract 

Many online marketplaces enjoy great success. Buyers and sellers in successful markets carry out co- 

H : . . . 

, operative transactions even if they do not know each other in advance and a moral hazard exists. An 

C/3 ' indispensable component that enables cooperation in such social dilemma situations is the reputation 

system. Under the reputation system, a buyer can avoid transacting with a seller with a bad reputation. 
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A transaction in online marketplaces is better modeled by the trust game than other social dilemma 
games, including the donation game and the prisoner's dilemma. In addition, most individuals partic- 
ipate mostly as buyers or sellers; each individual docs not play the two roles with equal probability. 



CO , Although the reputation mechanism is known to be able to remove the moral hazard in games with 

o 

asymmetric roles, competition between different strategies and population dynamics of such a game are 



not sufhciently understood. On the other hand, existing models of reputation-based cooperation, also 

known as indirect reciprocity, are based on the symmetric donation game. We analyze the trust game 
5— i ■ . 

, with two fixed roles, where trustees (i.e., sellers) but not investors (i.e., buyers) possess reputation scores. 

We study the equilibria and the replicator dynamics of the game. We show that the reputation mecha- 
nism enables cooperation between unacquainted buyers and sellers under fairly generous conditions, even 
when such a cooperative equilibrium coexists with an asocial equilibrium in which buyers do not buy and 
sellers cheat. In addition, we show that not many buyers may care about the seller's reputation under 
cooperative equilibrium. Buyers' trusting behavior and sellers' reputation-driven cooperative behavior 
cocvolve to alleviate the social dilemma. 
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Introduction 

The number of transactions executed in online marketplaces such as eBay is soaring up. To buy a desired 
item, a buyer must first trust in a seller by paying in advance. Because the seller may lose little by 
dismissing a single buyer, the seller may be tempted to ship a counterfeit item or may not even transport 
the purchase to the buyer. If many sellers behave maliciously toward buyers, the marketplace would 
collapse. Here is a moral hazard. A classical example in which counterfeit items would prevail is the 
"market for lemons" or the used car market [1]. Nevertheless, many auction sites and related online 
services, including opinion forums, price comparison sites, and product review sites, enjoy prosperity 
without seriously being swamped by the malicious behavior of users [5H5]. 

The main mechanism to elicit the cooperative behavior of sellers in such a social dilemma situation is 
the online reputation management system, also called the feedback mechanism [5H5] . When a reputation 
management system is implemented, a buyer is invited to evaluate the seller after a transaction so that 
other buyers can refer to the reputation of this seller in the future. A seller with a good overall reputation 
would successfully sell items to many buyers in the long run, whereas a seller with a bad reputation would 
be avoided by buyers. In a seminal paper, Klein and Lefher analyzed the role of reputations in alleviating 
a moral hazard [B]. 

Reputation mechanisms in online marketplaces are often cited as a successful example of indirect 
reciprocity [71[5]. Indirect reciprocity (precisely, downstream or vicarious reciprocity as its major subtype 
[Slin]) is a mechanism for the alleviation of social dilemmas. It dictates that an individual i with a 
good reputation is helped by another individual that i has not met. i may also help other individuals 
that i does not know. In fact, most buyer-seller pairs conduct only one transaction on eBay, such 
that a buyer probably does not know the seller with whom the buyer is about to transact |10| . It is 
theoretically established that indirect reciprocity enables cooperation in social dilemma games under 
proper conditions [SlI^ fTIHTB] . 

However, the mechanism governing cooperation between unacquainted buyers and sellers observed in 
real online transactions does not resemble that provided by these models. The existing models of indirect 
reciprocity are mostly based on the donation game, which is a type of social dilemma games. In the 
donation game, two players are chosen from a population, one as donor and the other as recipient. If the 
donor helps the recipient, the recipient gains a benefit, which is larger than the cost that the donor is 
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charged. If the donor does not help the recipient, the donor and the recipient gain nothing. The donor's 
help contributes to social welfare, whereas the donor is better off withholding the help. 

In the previous models of indirect reciprocity [51[^ [TT| - |^ . each player is selected as many times as 
donor and recipient per generation (we discuss an exception |23j in the Discussion). Therefore, the players 
are essentially involved in a symmetric prisoner's dilemma game. In contrast, the social dilemma game 
effectively played in online marketplaces is a highly asymmetric game. Buyers and sellers are distinct 
roles that each individual does not play with equal probability |10|. In addition, in the donation game 
and the symmetric prisoner's dilemma, there is no concept wherein one player invests trust in a peer 
player in the one-shot game. Theoretical models of reputation-based cooperation using different social 
dilemma games such as the ultimatum game also assume symmetrization of the two roles [241125] . This 
is also the case for the models of reputation-based cooperation analyzed in economic literature [261127] . 

The trust game [25H?T] seems to be a much better model for online marketplaces [7|- As shown in 
Fig. [U the buyer, also called the investor, first decides whether to buy an item from the seller. If the 
buyer buys, the seller, also called the trustee, decides whether to ship the appropriate item to the buyer. 
If the buyer buys and the seller does not ship, succumbing to the temptation to defect, the seller gains 
the largest payoff 1, and the buyer gains the smallest payoff —1. If the buyer buys and the seller ships, 
both players obtain a relatively large payoff r, where < r < 1. If the buyer does not buy, both players 
gain a relatively small payoff 0, which is the unique Nash equilibrium of the game. A cooperative society 
is realized when the buyer buys and the seller ships. In laboratory experiments, humans cooperate to 
some extent in the trust game [5DH55] . and reputation mechanisms enhance cooperation [71 IMH55] . The 
trust game with a reputation mechanism also approximates the situation of commerce conducted by the 
medieval Maghribi traders [371138) and the market for lemons (if a gossip-based reputation mechanism is 
operational) [T]. 

It was shown in a seminal paper that cooperation based on reputations is possible in the essentially 
asymmetric trust game Nevertheless, several important questions in this framework are theoretically 
unresolved. Is cooperation more ubiquitous than uncooperation, in particular when these two situa- 
tions are both stable equilibria? How do different reputation-based strategies of buyers compete in a 
population? How does the reputation-based cooperation emerge through population dynamics? Non- 
evolutionary numerical results for the trust game with reputation mechanisms [391I40| do not explain the 
stability and emergence of cooperation. An evolutionary theory [51l25| and numerical simulations [41] 
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showed that reputations induce cooperation in the trust game. However, in these papers, each player 
serves the two roles with equal probability such that the game is essentially the symmetric prisoner's 
dilemma. 

We theoretically clarify the possibility of reputation-based cooperation in the trust game by analyzing 
the Nash equilibria and the coevolutionary replicator dynamics of buyers and sellers. We show that 
coevolution of cooperative buyers and sellers is realized relatively easily. In particular, the fraction of 
buyers that score sellers does not have to be large, and many buyers do not discriminate between good 
and bad sellers even when cooperation prevails. 

Model 

Trust game 

We analyze equilibria and evolutionary dynamics of the trust game (Fig. [1} in an infinite population of 
four types of buyers and two types of sellers under a reputation mechanism. Each seller possesses the 
binary reputation, good (G) or bad (B), that dynamically changes as a result of the single-shot trust 
game. Referring to the two reputations as G and B is purely conventional. 

In a time unit, each seller ig plays the trust game with a randomly chosen buyer i^. The buyer ib first 
decides whether to buy an item from ig possibly on the basis of ig's reputation. If i^, does not buy, no 
transaction occurs, leaving the payoff to both ib and ig- If ih buys, ig decides whether to ship the item 
(cooperate; C) or not (defect; D). If ig ships the item, then both ib and ig obtain r. If ig does not ship the 
item and exploits ib, is gains 1, and ib gains —1. If r > 1, it is beneficial for both players to cooperate. 
If r < 0, transaction would never occur irrespective of the reputation mechanism. We set < ?' < 1 to 
represent the social dilemma. 

We repeat the procedure explained above for T time units such that each player plays the trust game 
T times on an average. We assume that 1 T ^ N such that the probability that the same pair of 
buyer and seller interact more than once within time T is infinitesimally small. 

Social norms 

When ib decides to buy, ih assigns G or B to ig on the basis of ig's action. The new reputation of ig is 
instantaneously propagated to the entire population such that any buyer can refer to this information 
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when playing with is in later times. We refer to the rule according to which the buyer assigns a reputation 
to the seller as a social norm. 

An intuitively rational social norm, which reputation mechanisms in successful online marketplaces 
apply, is to assign G and B when is has cooperated and defected, respectively. This norm is called image 
scoring [Tl][T2]. Alternatively, ib may assign G no matter whether is cooperates or defects. We call this 
social norm indifferent scoring. A buyer is assumed to commit the assignment error with probability 
< /i < 1/2 such that the seller receives a reputation that is contrary to what is expected from the social 
norm. 

In fact, some but not all of the buyers may be interested in rating sellers [2]-[4]. To investigate this 
scenario, we consider a case in which a buyer has a unique scoring type as well as strategy. We assume 
that a fraction of 6 and 1 — 9 buyers are image scorers and indifferent scorers, respectively. We also 
assume that the scoring type does not affect the buyer's payoff, such that the fraction of image scorers in 
the population does not change in the course of the replicator dynamics. Alternatively, we can assume 
that each buyer is a permanent indifferent scorer or permanent image scorer. This assumption may be 
controversial. We will return to this issue in Discussion. 

We do not assume the reputation for buyers because in online marketplaces, the impact of the seller's 
reputation is much larger than that of the buyer's reputation [3113]. Previous laboratory experiments that 
modeled the situation in auction sites also neglected the reputation of buyers [TKinilM] • 

Strategies 

The probability that the buyer decides to buy from G and B sellers is denoted by and 5b, respectively. 
We consider four strategies for buyers: unconditional buyer (Buy) specified by 5g = 5b = 1 — e, where 
< e < 1/2; discriminator (Disc) specified hy bQ = 1 — e, bB = e; anti-discriminator (AntiDisc) specified 
by 5g = fij = 1 ^ e; and unconditional no-buyer (NoBuy) specified by 6g = = (■ 

As introduced in section "Trust game", sellers have two strategies, C and D. For simplicity, we assume 
that the seller's action is deterministic, whereas the buyer's action is stochastic. 
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Results 
Payoffs 

The reputation of a seller obeys a Markov chain with two states G and B. To obtain the payoffs, we adopt 
the deterministic calculations developed by Ohtsuki and Iwasa P^[T51[T5] . 

If i (0 < t < r) is sufficiently large, we can approximate the probability of the G reputation for a C 
seller and that for a D seller by the population averages denoted by pc and pu , respectively. The dynamics 
of the reputation averaged over the C sellers and that averaged over the D sellers are represented as 



dpc 

dt 
dpB 
dt 



PC 
PD 



-IM 



-IN 



-IM 



-IN 



+ (1 - e)bc ^p + {i^pc) ^eb^ + (1 - 0)6b J (1 - p), 
ef^a -p) + ii- o)f^p\ + (1 - pd) \efnp + (1 - - p) 



(1) 

(2) 



where 6q and fog (a = IN for indifferent scorer or IM for image scorer) are the probabilities that the buyer 
of scoring type a decides to buy from a G and B seller, respectively. For example, 91}^ + (1 — OyE^Q 
on the right-hand side of Eq. ([T]) represents the probability that a buyer decides to buy from a C seller. 
Because the multiplicative factor p represents the probability that the C seller that has cooperated 
mistakenly receives B reputation, the first term on the right-hand side of Eq. ([TJ represents the case 
where the reputation of C seller turns from G to B. Similarly, the second term represents the case where 
the reputation of C seller turns from B to G. It should be noted that the seller's reputation does not 
change when the buyer decides not to buy. 

The probabilities that the buyer decides to buy from a G and B seller are respectively represented as 



^G=(i-e)(y? + y2) + <2/3+y4), 
&B=(i-e)(y? + y3) + <2/2+y4), 



(3) 
(4) 



where yj^ and yf^ are the fractions of buyers with strategy i among the indifferent scorers and among the 
image scorers, respectively. Buy, Disc, AntiDisc, and NoBuy correspond to i = 1, 2, 3, and 4, respectively; 
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For simplicity, wc assume that 

y,^y™ = y,I^ (1<*<4) (5) 

is initially satisfied. In other words, the scoring type and strategy are independent of each other. Note 
that < ?/i < 1 (1 < i < 4) and Ylt=i Hi = 1- Because Eqs. ([2]), ©, and (P imply 6g = b^c = and 
6b = b^B — b™ , Eqs. ^ and ^ give the limit values 

Ph - r^'r'^'^'.r . (6) 



+ (1 - P-)bB 



C26B , . 

Pu =^ — : — ^> (7) 



where 



6g =(l-e)(yi+ tj2) + £(2/3+2/4), (8) 
6b =(l-e)(yi+ 2/3) + £(2/2+2/4), (9) 



and we set 



Cl ^9(1 - fi) + (1 - 9)n, (10) 

C2 =0/i+(l-0)(l-/i), (11) 

for notational convenience. Equation ([6]) does not depend on 6, which reflects the fact that both the 
indifferent and image scorers evaluate C sellers as G with a large probability 1 — yU (> 1/2). In contrast, 
Eq. ([7]) implies that pjj decreases with 6. This is because the image scorer may issue a B reputation with 
a large probability, whereas the indifferent scorer does not. 

For sufficiently large T, the reputations are in the equilibrium almost all the time. Then, the buyer's 
payoff should be equal to 

i^'(6G, 6b) ^rx [p*cbo + (1 - ph)bB] - (1 - x) [p*^bG + (1 - pJ,)6b] 
^rx [(1 - Ai)6G6B + /j6g6b] (1 - x)(c26g6b + ci6g6b) 



pbG + {l-p)bB C16G + C26B 



(12) 
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where 



(&G,&b) = < 



(l-e,l-e), 


if i 


= 1 (Buy), 




if i 


= 2 (Disc), 




if i 


= 3 (AntiDisc), 




if i 


= 4 (NoBuy), 



and a; (0 < a; < 1) is the fraction of C sellers. The payoffs for C and D sellers are given by 

rbobB 



= r [p*cbG + {1 - Ph) ' 



fibc + (1 - p)bB 



and 



bobs 



(13) 



(14) 



(15) 



ci5g + C26B 
respectively. 

Even if we consider the stochastic dynamics of the reputation and the buyer's action, the values of 
the payoffs derived above give the precise mean values. 

Proposition 1: Regardless of the initial reputation value of a seller, in the limit T — > co and 
T/N 0, the expected payoff for the buyer is given by Eq. and that for the seller is given by 
Eqs. dm) and P^. 



Proof of Proposition 1 

The reputation score of the seller obeys a Markov chain with two states. Consider a C seller with 
reputation G. The G reputation does not change in one time step if the paired buyer ib decides to buy 
with probability 6g and correctly assign G to is with probability 1 — /i or, ib decides not to buy with 
probability 1 — 6g- Otherwise, ig's reputation turns into B. When ig has reputation B, it is unchanged if 
ih decides to buy with probability fee and commit assignment error with probability fi, or ib decides not 
to buy with probability 1 — 6b- Otherwise, is's reputation turns into G. 
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Therefore, the transition matrix of the Markov chain is represented as 



M = 



( 



(1 - aO^g + (1 - bo) 



(1 - /i)^'B 



/.t6B + (1 - ^b) 



(16) 



where Mij (1 < j < 2) represents the transition probabihty from state i to state j, and we associate G 
and B with states 1 and 2, respectively. Because M is a nondegenerate (right) stochastic matrix, we can 
decompose M using the left and right eigenvectors corresponding to eigenvalue 1 as 



where — 1 < A < 1 is the other eigenvalue of M, and v and u are the left and right eigenvectors 
corresponding to A, respectively. We do not calculate A, v, and u because their values are immaterial in 
the following arguments. Note that the eigenvectors are normalized such that 



Assume that the C seller initially has reputation G and B with probability pc.init and pB.init, 
respectively, where pc.init + PB.init ~ 1- Then, the probability that ig's reputation is G and B after 
playing t games is given by the first and second columns of (pc.init PB.init)-^^*, respectively. 

The expected payoff for is in a single game is equal to r multiplied by the probability that ib decides 
to buy. Therefore, the expected payoff for ig per single game, averaged over 1 < t < T, converges in the 




(17) 




(18) 



(19) 
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limit T — > oo to 



1 



T^oo T i ^G,init PB.init ) {l + M + M 



PCinit PB,init 



M 



rbr 



rbB 




(1-m)&b 




(l-M)feE 



/j6G + (l-/i)&B /ihG + (l-A')&E 



1-A^ 
1-A 



-UV 





rbob^ 



^ibc + (1 - ^i)bB 



(20) 



(21) 



(22) 



which reproduces Eq. (ITil) . The expected payoff for the D seUer, given by Eq. (jTS]), can be derived in the 
same manner. 

Next, we calculate the payoff for a Buy buyer i^. In each time step, the expected number of C 
seller with reputation G and B with whom ib is paired is equal to the first and second columns of 
a;(pGanit PBanit)A^*, respectively. When the C seller ig has reputation G (B), the expected payoff for 
in a single game is equal to tUg (rbB)- Therefore, the contribution of the C seller to the expected payoff 
for Zb per single game, averaged over T games, converges to 



lim 



T 



PGjnit PBanit 



I + RI + 



M 



T-1 




+ (1 - M)fe 



(23) 



This quantity is equal to the first term on the right-hand side of Eq. (jl2[) when 6g = 6b = 1 ^ e (i-O-, 
Buy). Analogous calculations for the case of D seller yields the second term on the right-hand side of 
Eq. when 6g = &B = 1 ^ £• The payoff for Disc, AntiDisc, and NoBuy can be calculated in a similar 
manner. Here is the end of the proof. 



Nash equilibria 

Based on the expected payoff determined by Proposition 1, we identify the equilibria of the game. In 
the analysis, we exploit the fact that Pf{bQ^bB) is linear in 6g and 6b- There arc three types of Nash 
equilibria. The so-called uncooperative equilibrium is composed of NoBuy and the D seller. In the so- 
called cooperative equilibrium. Buy and Disc are mixed in the buyer's strategy and the probability of G 
is large in the seller's strategy. The cooperative equilibrium corresponds to the situation in which buyers 
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and sellers do not repeatedly interact but trust each other on the basis of the reputation mechanism. 
When it exists, it coexists with the uncooperative equilibrium. The other equilibrium appears only for a 
singular parameter set. Therefore, we are not concerned with it in the later analysis. 



Proposition 2: The asymmetric trust game with a reputation mechanism whose expected payoffs 
are defined by Eqs. (fT2| . ([T4| . and ([TS]) possesses the following three types of Nash equilibria. 



1. Uncooperative equilibrium: combination of NoBuy and x* = 0. This pure-strategy Nash equilib- 
rium is also strict. 

2. Cooperative equilibrium: the mixture of Buy and Disc, with the probability of Buy and Disc being 



(-/i + rci)(l - e) + (1 - ^ - rc2)e 
(l-^-rc2)(l-2e) 



(24) 



and 2/2 = 1^2/1; respectively. The probability of C seller is given by 



Cl 



Cl + M 



(25) 



The cooperative equilibrium exists when 



A^(l - e) + (1 - A^)e 
ci(l - e) + C2e 



< r < 1. 



(26) 



The cooperative equilibrium is also asymptotically stable under the replicator dynamics. For com- 
pleteness, the replicator dynamics of buyers and sellers are given by 



At 
Ax 
dt 



-x{l ~ xybob^ 



^fec + (1 - m)&b ci6g + c25e 



respectively, where the buyer's mean payoff is given by 



(27) 



(28) 



1 - x 



fibc + {1 - fi)bB ci6g + C26b 



bcbB- 



(29) 
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3. A singular equilibrium: combination of Disc buyer and a mixed seller's strategy with any x satisfying 

<x< (30) 



1 - /X + C2 M + Cl 



This equilibrium exists when 



^ 1 (31) 



/i(l - e) + (1 - /i)e ci(l-e) + C2e 

We remark that the cooperative equilibrium is called so because lim^^o x* = 1. We prove Proposition 
2 in the next section. 

It should be noted that extending the concept of the evolutionary stability to the asymmetric game is 
not straightforward. In the matrix game, a strictly (i.e., completely) mixed Nash equilibrium cannot be 
an asymptotically stable equilibrium under the replicator dynamics, and an evolutionarily stable strategy 
in the asymmetric game is necessarily a (pure) strict Nash equilibrium |42H45j . Nevertheless, Proposition 
2 dictates that the cooperative equilibrium is an asymptotically stable strictly mixed strategy. This is 
possible because the payoff values are density-dependent in our model; it is not a matrix game. Therefore, 
we directly prove that the cooperative equilibrium is asymptotically stable in the replicator dynamics. 

Proof of Proposition 2 

We identify all the mixed-strategy Nash equilibria of the asymmetric game whose payoffs are given by 
Eqs. dUl), (HI, and (HH). 



One buyer's strategy 

Consider a possible equilibrium composed of a single buyer's strategy. If there is only Buy, AntiDisc, or 
NoBuy, we substitute (fec^e) = (1 ^ 1 ~ e)j (e, 1 — e), and (e, e), respectively, in Eqs. p4)) and (fT5| to 
obtain — Pf^ < for ?- < 1. Therefore, x* = must be satisfied in a possible Nash equilibrium. 
When X* = 0, Eq. ^ is simplified to 

P^(6c,6b) = -^^^^4^±^, (32) 

CiOg + C2OB 

where ci and C2 are defined in Eqs. (fTO|) and (fTTj) . respectively. Equation ([32|) implies that the payoff for 
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NoBuy is larger than those for Buy, Dise, and AntiDisc. Therefore, the combination of NoBuy and D seller 
is the only (strict) Nash equilibrium allowed in this regime. We call this equilibrium the uncooperative 
equilibrium. 

Suppose instead that there is only Disc. If 

r 1 

0, (33) 



fibc + {1 - fi)bB cibo + oibi 
where 6g = 1 — e and 6b = e, we obtain ~ for any x. Substituting Eq. in Eq. yields 

b., , ^ [-^(1 - At) - (1 - x)c2] bcbB + [xfi - (1 - x)ci] bcbB 

-fi(OG,OB) = = — ■ = . (34) 

ciOg + C26B 

Equation (p4|) indicates that Disc obtains a payoff larger than or equal to those of Buy, AntiDisc, and 
NoBuy if 

^2 <^<2l, (35) 



1 — /i 1 — X fl 

The range of x that satisfies Eq. ([55)1 always exists because fj. < 1/2 guarantees 02/(1 — /x) < ci//x 
Therefore, the combination of Disc and Eq. (|55|) . i.e.. 



<x< (36) 

1 - /.J + C2 A* + Cl 

yields Nash equilibria. 

If Eq. (j33|) is not satisfied, which is a generic case, only x = and x = I may result in a Nash 
equilibrium because the difference between Eqs. ([T4)) and ([T5|) is independent of x. li x* =0 (i.e., 
< Pg), Eq. (dll) is simplified to 

PriboM) = ''f-'^''' . (37) 

ci(l - e) + C2e 

Equation ([37]) implies that NoBuy gains a larger payoff than Disc. If x* = 1, substituting bo ~ 1 — £ and 
6b = e in Eqs. (fT4|) and (fTSl) and setting > lead to the following necessary condition for Disc to 
be Nash: 

r > + (38) 

ci(l - e) + C2e 
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Equation ([551) replicates Eq. (pS)) . When Eq. ([55]) is satisfied, substituting = 1, 5g = 1 — e, and 5b = e 
in Eq. ^ yields 

i^^(^c,^B)^ ^^^^7;^^^f+^^^7^^'-J . (39) 

/i(l - e) + (1 - /i)e 

Therefore, Buy gains a larger payoff than Disc, such that the pure Disc is not Nash. 

In conclusion, the only pure (strict) Nash equilibrium is the uncooperative equilibrium composed of 
NoBuy and D seller. 

Mixture of two buyer's strategies 

Consider the mixed strategies (i.e., coexistence) of two buyer's strategies as candidates of Nash equilibria. 
If we select two strategies out of Buy, AntiDisc, and NoBuy, we can show Pq < in a manner similar to 
the case of the one buyer's strategy. In this case, x* ~ must hold true in the equilibrium. Equation (1121) 
with X* = indicates that the payoff for NoBuy is larger than that for AntiDisc, which is larger than that 
for Buy. Therefore, such a mixed-strategy Nash equilibrium, in which the payoff for the two strategies 
of buyers must be the same, does not exist. This implies that Disc must be selected as one of the two 
buyer's strategies in a possible Nash equilibrium. 

Mixture of Buy and Disc: cooperative equilibrium: Consider a mixture of Buy and Disc, which we call 
the cooperative equilibrium. Note that 

bG =1 - e, (40) 
6b =(1 - e)2yi +ey2 = (1 - 2e)yi + e. (41) 

Because P}'{1 — e, 1 — e) = Pi'i^ ^ must be satisfied in the Nash equilibrium, the coefficient of 5b in 
Eq. (fT2|) must be equal to 0. This condition combined with Pq = Pq yields 

bl = + (42) 

1 - /i - rc2 



and 



Equation (j43|) replicates Eq. ([25 



X* = — (43) 
ci + M 
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The mixture of Buy and Disc is equivalent to e < 5g < 1 — e. The inequality 63 < 1 — e is always 
satisfied if r < 1 (note that the denominator of Eq. is always positive if /i < 1/2). The inequality 
e < 63 is equivalent to Eq. ([38|) . Given Eq. (p8|) . the equilibrium probability of Buy (i.e., yl) and that 
of Dise (i.e., y2 ~ 1 — yl) in the cooperative equilibrium, shown in Eq. ()24[) . are derived by substituting 
Eq. gll) in 

= (1 - ^)y*i + ^y*2 = (1 - 2e)2/* + e. (44) 

To show the stability of the cooperative equilibrium, we first compare ^,^(1 — e, 1 — e) = P}'{1 — e, e), 
i.e., the payoff for Buy and that for Dise, and P}'{e,e), i.e., the payoff for NoBuy, in the cooperative 
equilibrium. NoBuy gains a smaller payoff than Buy and Dise if the coefficient of Bq in Eq. (|12p is 
positive in the cooperative equilibrium. The substitution of Eqs. and P5)) in Eq. suggests that 
this condition is equivalent to 

l-^.>^. (45) 

Cl 

Equation (|45p is equivalent to /i < 1/2. which we have assumed. Therefore, NoBuy gains a smaller payoff 
than Buy and Disc. Because P^{1 - e, 1 - e) = i^^(l - e, e) implies P}'{e, 1 - e) = P^{e, e), AntiDisc also 
gains a smaller payoff than Buy and Disc in the cooperative equilibrium. 

Consider the invariant subspace of the strategy space where only Buy and Disc buyers (and C and D 
sellers) exist. The mixed strategy specified by {yi,x) = (yl,x*) is a Nash equilibrium when the buyer's 
strategies are restricted to either Buy and Disc because P}'{1 — e, 1 — e) ~ Pi'ii — e, e) and Pq = Pp. 
Because P^{e,l- e) = P}'{e,e) < P}'{1 - e, 1 - e) = P}'{1 - e,e), {yi,x) {yl,x*) is a Nash equilibrium 
when all the four types of buyer's strategies are allowed. 

The inequality P}'{e, 1 — e) = Pi'i^, e) < -Pi^(l ~ 1 ^ e) = ^,^(1 ^ ^1 f) also assures that, under the 
replicator dynamics, the cooperative equilibrium is asymptotically stable against the introduction of an 
infinitesimal fraction of AntiDisc or NoBuy. Therefore, we are left to show the asymptotic stability of the 
cooperative equilibrium within the abovementioned two-dimensional subspace parametrized by yi and x. 
For the sake of the linear stability analysis, we take 5b and x as the independent variables and linearize 
Eqs. (j27p with i = I and (j28p and substitute the one-to-one relationship between yi and 6b given by 
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Eq. (|4ip in Eq. (j27p . The Jacobian in the cquihbrium is given by 

dx_ d dx 
OEb dt dx dt 

where ah the derivatives are evaluated at (6b, x) = (63, a;*), and 

5^ ^'\m(1-6) + (1-m)&; c,{l~e)+C2b*^y 

[ + ^^^1 , (49) 

db^At ' ^\Kl-e) + (l-^)6;]2 [ci(l-e) + C26;pj ' 

The necessary and sufficient condition for the cooperative equilibrium to be stable under the replicator 
dynamics is given by trace J < and det J > 0. By substituting Eqs. (|42|) and (|43l) in Eq. (|47p . we obtain 



trace J = ^^^^ 7^^^ ^ ' ^^^^"^^ ' ^' '^^^^^ f-i^ + ) . (51) 
Because the right-hand side of Eq. is positive, we obtain 

55b (l-e)(ci-/i)2 V ^ 2' ^ ^ 



Equations (|5ip and (1521) suggest that the cooperative equilibrium is stable if and only if 

> C2. (53) 

r 

Equation ([53]) is satisfied for any r (0 < r < 1) if ^ < 1/2. Therefore, the cooperative equilibrium is 
asymptotically stable under the replicator dynamics. 

Mixture of Disc and AntiDisc: If Disc and AntiDisc are mixed in the equilibrium, 



(54) 
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holds true. Because P/'(6g7&b) is linear in 6g and &b, the coefficient of 6g and that of 6b must be the 
same for Eq. ([5l)) to be satisfied. If both coefficients are positive, the payoff for Buy is larger than that 
for Disc and AntiDisc in this equilibrium. If both coefficients are negative, the payoff for NoBuy is larger 
than that for Disc and AntiDisc in the equilibrium. In either case, the mixture of Disc and AntiDisc 
cannot be Nash. 

Mixture of Disc and NoBuy: If Disc and NoBuy are mixed in the equilibrium, we obtain P}'{1 — e, e) = 
P,^(e, e) and &b = = £• Therefore, the coefficient of Bq in Eq. ([T2|). which we denote by h{y2) as a 
function of the density of Disc, is represented as 

Hy2) = T ^ f— — ' (55) 

/UOq + (1 - /i)e CibQ + C2e 

where 

= (1 - e)v2 + e(l - V2) (56) 
must be equal to in the equilibrium. From h{y2) = and = P^, we obtain 

bo = (57) 

-/i + rci 

and 

C2 



(58) 



1 - ^ + C2 

If dh(y2)/dy2 > in the equilibrium. Disc (NoBuy) in a mixed strategy in which there are slightly 
more (less) probability of Disc than in the equilibrium {bQ,x) = {bQ,x*) obtains a larger payoff than 
NoBuy (Disc). In this case, (bQ,x*) is not Nash because such a slightly modified mixed strategy of the 
buyer obtains a larger payoff than (bQ,x*). On the basis of the relationship dh/dy2 = (1 — 2e)dh/dLbQ, 
which is derived from Eq. (j56|) . we rewrite h{y2) as /i(6g) and examine dh{bQ)/dbQ in the equilibrium 
(note that we assumed e < 1/2). Using the fact that the right-hand side of Eq. ([55]) is equal to when 
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{bQ,x) = {bQ,x*), we obtain 



-TX*{\ - (l-x*)ciC2e 



[nb^ + (1 - A<)e]2(ci6G + C2e) 



>0 



(59) 



if /I < 1/2. Therefore, the mixture of Disc and NoBuy is not Nash. 
Mixture of three or four buyer's strategies 

If three or four buyer's strategies are mixed in an equihbrium, their payoffs must be identical. Therefore, 
the coefficient of be and that of 5b in Eq. ((T^ must be equal to 0, which requires 6'(2/i — 1) = 0. Because 
/i < 1/2, this relationship is not satisfied when the image scorer exists (i.e., 6 > 0). 

When 9 ~ 0, wc obtain < Pfy by substituting ci = /i and C2 = 1 — (derived from Eqs. ([T(I|) and 
([TT]) ) in Eqs. and Therefore, x* ~ must hold in the equilibrium. In this situation, Eq. ([T^ 

is reduced to 



Equation ([SO]) indicates that NoBuy's payoff is larger than Disc's and AntiDisc's payoffs, which are larger 
than Buy's payoff. Consequently, three or four buyers' strategies cannot be mixed in an equilibrium. 
Here is the end of the proof. 

Indifferent scoring 

In a case with only indifferent scorers (i.e., 9 = 0), Eq. (|26p is never satisfied (and Eq. (|3T|) is not satisfied, 
either). Therefore, the uncooperative equilibrium is the only Nash equilibrium. This outcome is expected 
because, under indifferent scoring, the players perform the usual trust game |28fl31) . 

Image scoring 

When there are only image scorers (i.e., 9=1), the cooperative equilibrium is realized in a wide parameter 
region because Eq. ((26)) with 9=1 and /i — !■ is reduced to e/(l — e) < r < 1; e < 1/2 is the probability 



Pi{bG,bB) 



(1 - n)bGbB + M^G^B 
^ibo + (1 - /i)5B 



(60) 
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that the buyer misimplcments the action. In the Hmit /i — >■ 0, the equihbrium probabihty of Buy (i.e., 
yl) is plotted as a function of e and r in Fig.[2Ja). In the parameter region in which y* = (black region 
in Fig. mja)), the cooperative equilibrium does not exist. In the cooperative equilibrium, the fraction 
of Buy is large for a large r or a small e. In particular, lim^_>.o.r-i.i 2/i = 1 irrespective of the value 
of e. In the limit r ^ 1, the trust game is a weak social dilemma such that the D seller's payoff is 
only infinitesimally larger than the C seller's payoff. The advantage of the D seller is offset by the B 
reputation that the D seller receives from just a small fraction of Disc buyers (i.e., ?/2 ^ 1)- Even if a 
majority of buyers is nondiscriminative Buy, cooperation between buyers and sellers can be sustained by 
the reputation-regarding behavior of a small fraction of Disc. 

For a general value of 9, suppose that Eq. (1261) is satisfied such that the cooperative equilibrium is 
Nash. For e = 0.1 and fi ^ 0, yl in the cooperative equilibrium is shown for various values of 9 and r in 
Fig. [2Ib). yl increases as 6 and r increase. 

For some values of /i and e, the critical line obtained from Eq. ([25)1 is plotted in Fig. [3] The cooperative 
equilibrium exists and is stable above the critical line. Figure [3] indicates that cooperation based on the 
reputation mechanism occurs in a large parameter region, particularly for large values of 9 and r. The 
critical line is rather insensitive to /i and relatively sensitive to e. Nevertheless, cooperation is possible 
even for a large probability of the implementation error e = 0.2. 

Attractive basin of the cooperative and uncooperative equilibria 

The cooperative and uncooperative equilibria can coexist. A fuller understanding of the model requires 
a global analysis of the replicator dynamics to determine which of the two equilibria is more likely to be 
attained. In addition, periodic or chaotic attractors may exist when a population evolves. To exclude 
this possibility and examine the attractive basin of the two equilibria, we numerically run the standard 
two-population replicator dynamics |43H45) from various initial conditions to identify the limit set of the 
dynamics. For fixed parameter values, we assume that the initial condition is distributed according to the 
uniform density on the state space, i.e., {{yi,y2,y3,y4,x) ■ Hi > {1 < i < 4),^^^]^yi = 1,0 < x < 1}. 
It should be noted that Eq. ([5]) is preserved under the replicator dynamics because the buyer's payoff 
depends on the buyer's strategy but is independent of whether the buyer is an indifferent or image scorer. 
We have implicitly assumed in Eqs. (P7)) and that sellers and buyers have identical adaptation rates. 
However, the following results are qualitatively the same even if the two adaptation rates are different. 
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The replicator dynamics arc four-dimcnsional, with three degrees of freedom derived from the buyer's 
population and one degree of freedom derived from the seller's population. Note that the selection occurs 
separately among buyers and sellers. 

For an expository purpose, we start with the system without AntiDisc. There are three strategics for 
buyers and two strategies for sellers. The replicator dynamics are three-dimensional, and the state space 
is a triangular prism defined by {(j/i, ?/2, 2/4, a;) : yi, 2/2, 2/4 > 0, 2/3 = 0, 2/1 + 2/2 + 2/4 = 1, < x < 1}. For 
/i = 0.02, e = 0.1, r = 0.15, and 9 = 1, initial conditions located below the boundary shown in Fig. |4] 
are attracted to the uncooperative equilibrium. We confirmed that all the complementary regions in the 
interior of the triangular prism are attracted to the cooperative equilibrium. Our numerical simulations 
strongly suggest that there is no other limit set. 

To better quantify the possibility of cooperation, we measure the volume of the attractive basin of 
the cooperative equilibrium. The relative volume of the attractive basin in the triangular prism is shown 
in Fig. [S{a) for ^ = 0.02, e = 0.1, and various values of r and 6. The critical line for the existence and 
stability of the cooperative equilibrium, implied by Eq. (|26p . is shown by the solid line. We find that the 
cooperative equilibrium is attractive for a substantial variety of initial conditions as and r increase. 

In the presence of four strategics for buyers, the relative volume of the attractive basin of the cooper- 
ative equilibrium in the state space is shown in Fig. [SJb). The results are qualitatively the same as those 
shown in Fig. [5Ja). We confirmed that the rest of the state space belongs to the attractive basin of the 
uncooperative equilibrium. The introduction of AntiDisc does not inhibit the evolution of cooperation. 

Discussion 

For the trust game, we have shown that cooperation between unacquainted buyers and sellers can be 
established under the image scoring norm (i.e., reputation mechanism). In the cooperative equilibrium, 
the population of buyers (i.e., investors) is a mixture of Buy (unconditional buyer) and Disc (discriminator 
that decides whether to buy depending on the seller's reputation). The majority of sellers (i.e., trustees) 
reciprocates the buyer's trust although the sellers are not expected to meet the same buyers again. It 
should be noted that not every buyer discriminates between good and bad sellers in the cooperative 
equilibrium. This feature is shared by some previous models of indirect reciprocity [14[|171fT9] . The 
probability of discriminators can be small depending on the parameter values. In addition, the buyer's 
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reputation may be of little practical use for maintaining cooperative transactions. This claim is consistent 
with the previous theoretical result [5] and the empirical finding that reputation for a seller has a greater 
impact than that for a buyer [51[51ll0|. 

Our model and results are distinct from previous ones obtained from the models using the symmetrized 
donation game, which we call indirect reciprocity games for now j8ll9l lllfll6j . First, when cooperation 
prevails, a player with a good reputation is helped by unacquainted players in the indirect reciprocity 
games. In our model, a seller with a good reputation wins the trust, not explicit help, of unacquainted 
buyers. By reciprocating the buyer's trust, the seller obtains a relatively large momentary payoff and a 
good reputation. Then, a good reputation elicits trust and long-term cooperation from buyers. 

A second difference is in the consequence of the image scoring. In the indirect reciprocity games, 
defection against a bad player is regarded to be bad under the image scoring. Therefore, the image 
scoring does not yield cooperation [13H16| . In contrast, in our model, a discriminative buyer (i.e.. Disc) 
that defects against (i.e., does not buy from) a bad seller does not receive a bad reputation. This is because 
buyers do not own reputation scores by definition; the asymmetry of roles in the trust game allows the 
image scoring to support cooperation. Although a previous paper discussed this issue before |46j . we 
analytically derived the conditions under which cooperation based on the image scoring occurs. It should 
be noted that the image scoring norm is simpler than the social norms required for cooperation in the 
indirect reciprocity games [T5HTB1IT51I19) . 

In other models, the mere reputation mechanism enables cooperation among unacquainted players in 
the trust game and other games [ni[2H[2Sl[17] ■ However, the component social dilemma game in 

these studies is essentially symmetric. Our model is inherently asymmetric such that a player is either 
a permanent buyer or permanent seller. As compared to a recent paper in which impacts of asymmetric 
roles in the trust game are numerically studied |46j . we analytically established the conditions under 
which reputation-based cooperation occurs in the asymmetric trust game. In online marketplaces |10) . 
the market for lemons [T], and presumably many other transaction scenes, some people may participate 
entirely or mostly as buyers and others as sellers. 

The constructive role of reputations for the trustee (i.e., seller) in asymmetric interactions was for- 
mulated in a classic paper many years ago [B] . Our contribution to the understanding of this established 
mechanism is that we have clarified competition among different strategies using evolutionary game the- 
ory. 
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We have investigated a scenario in which indifferent scorers, which do not essentially score sellers, 
and image scorers coexist in a buyer's population. Remarkably, the fraction of image scorers needed for 
cooperation is not large; Eq. (pS)) indicates that the threshold fraction of image scorers is equal to 0.60 
for r = 0.2 and 0.038 for r = 0.8 when ji = 0.02 and e = 0.1. An alternative assumption for the behavior 
of indifferent scorers is that they do not alter sellers' scores rather than always give a good reputation to 
sellers. Analysis of this case is warranted for future work. 

An important limitation of the present study is that the fraction of indifferent scorers and that of 
image scorers are invariant over time. In other words, indifferent and image scorers are assumed to 
receive the same payoff if the strategy (Buy, Disc, AntiDisc, or NoBuy) is the same. In fact, the image 
scoring may be more costly than the indifferent scoring because the image scorer has to know and report 
whether sellers cooperate or defect. Therefore, an image scorer may be tempted to turn into an indifferent 
scorer if the incentive to rate sellers is absent pi[51ll0|. A similar cost is briefly mentioned in previous 
literature in the context of indirect reciprocity games [51l47|. In our model, cooperation disappears if 
there are too many indifferent scorers. This result parallels with that for the indirect reciprocity games 
in which cooperation is not realized if there are too few observers in the one-shot game [lTJ[TB]. In 
practice, rewarding image scorers and shutting down indifferent scorers' access to reputation information, 
for example, are means to circumvent the scoring cost We remark that the competition of social 
norms was analyzed in different models of indirect reciprocity |20H22j . 

In the context of asymmetric interaction between cleaner and client fishes, indirect reciprocity was 
investigated in an inherently asymmetric variant of the trust game with a binary internal state for the 
trustee [23j . Our model and results are distinct from theirs. In their model, a trustee reciprocates and 
attracts the investor when the trustee is in one particular state and exploits the investor by switching 
to the other state. The trustee does not steadily maintain a good reputation and uses the temporarily 
good reputation to exploit the investor. The authors acknowledge that their mechanism is different 
from the conventional concept of indirect reciprocity. In our model, the trustee (i.e., seller) steadily 
maintains a good reputation to invoke help from the investor (i.e., buyer). Our results suggest that, 
under appropriate conditions, the conventional indirect reciprocity may be established between cleaner 
and client fishes without resorting to the concept of the binary state. Finally, beyond the relevance to 
online transactions, our results provide a firm solution to the moral hazard problem that is represented 
by the trust game. Examples include offiine markets [B] such as the market for lemons [T] and labor 
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markets |291l33j . Implementing a reputation mechanism only for the seller (i.e., invcstee) induces trust 
and cooperation between unacquainted individuals in the trust game. Good cooperative sellers and 
trustful buyers coevolve. 

Acknowledgments 

We thank Michihiro Kandori for discussion and Hisashi Ohtsuki for providing valuable comments on the 
manuscript. 

References 

1. Akerlof GA (1970) The market for "lemons": Quality uncertainty and the market mechanism. 
Quarterly J Econom 84: 488-500. 

2. Resnick P, Zeckhauser R, Friedman E, Kuwabara K (2000) Reputation systems. Communications 
of the ACM 43: 45-48. 

3. Malaga RA (2001) Web-based reputation management systems: Problems and suggested solutions. 
Electronic Commerce Res 1: 403-417. 

4. Dellarocas C (2003) The digitization of word of mouth: Promise and challenges of online feedback 
mechanisms. Manage Sci 49: 1407-1424. 

5. Brown J, Morgan J (2006) Reputation in online auctions: the market for trust. California Man 
Rev 49: 61-81. 

6. Klein B, Leffler KB (1981) The role of market forces in assuring contractual performance. J Polit 
Economy 89: 615-641. 

7. Bolton GE, Katok E, Ockenfels A (2004) How effective are electronic reputation mechanisms? an 
experimental investigation. Manage Sci 50: 1587-1602. 

8. Nowak MA, Sigmund K (2005) Evolution of indirect reciprocity. Nature 437: 1291-1298. 

9. Sigmund K (2010) The Calculus of Selfishness. Princeton, NJ: Princeton University Press. 



24 



10. Resnick P, Zeckhauscr R (2002) Trust among strangers in internet transactions: Empirical analysis 
of ebay's reputation system. Adv Appl Microeconomics 11: 127-157. 

11. Nowak MA, Sigmund K (1998) Evolution of indirect reciprocity by image scoring. Nature 393: 
573-577. 

12. Nowak MA, Sigmund K (1998) The dynamics of indirect reciprocity. J Thcor Biol 194: 561-574. 

13. Leimar O, Hammerstein P (2001) Evolution of cooperation through indirect reciprocity. Proc R 
Soc B 268: 745-753. 

14. Panchanathan K, Boyd R (2003) A tale of two defectors: the importance of standing for evolution 
of indirect reciprocity. J Theor Biol 224: 115-126. 

15. Ohtsuki H, Iwasa Y (2004) How should we define goodness?~reputation dynamics in indirect reci- 
procity. J Theor Biol 231: 107-120. 

16. Brandt H, Sigmund K (2004) The logic of reprobation: assessment and action rules for indirect 
reciprocation. J Theor Biol 231: 475-486. 

17. Brandt H, Sigmund K (2006) The good, the bad and the discriminator — errors in direct and 
indirect reciprocity. J Theor Biol 239: 183-194. 

18. Ohtsuki H, Iwasa Y (2006) The leading eight: social norms that can maintain cooperation by 
indirect reciprocity. J Thcor Biol 239: 435-444. 

19. Ohtsuki H, Iwasa Y (2007) Global analyses of evolutionary dynamics and exhaustive search for 
social norms that maintain cooperation by reputation. J Theor Biol 244: 518-531. 

20. Chalub FACC, Santos EC, Pacheco JM (2006) The evolution of norms. J Theor Biol 241: 233-240. 

21. Pacheco JM, Santos EC, Chalub EACC (2006) Stern-judging: A simple, successful norm which 
promotes cooperation under indirect reciprocity. PLoS Comput Biol 2: 1634-1638. 

22. Uchida S, Sigmund K (2010) The competition of assessment rules for indirect reciprocity. J Theor 
Biol 263: 13-19. 

23. Johnstone RA, Bshary R (2007) Indirect reciprocity in asymmetric interactions: When apparent 
altruism facilitates profitable exploitation. Proc R Soc B 274: 3175-3181. 



25 



24. Nowak MA, Page KM, Sigmund K (2000) Fairness versus reason in the ultimatum game. Science 
289: 1773-1775. 

25. Sigmund K, Hauert C, Nowak MA (2001) Reward and punishment. Proc Natl Acad Sci USA 98: 
10757-10762. 

26. Raub W, Weesie J (1990) Reputation and efficiency in social interactions: an example of network 
effects. Am J Sociol 96: 626-654. 

27. Kandori M (1992) Social norms and community enforcement. Rev of Econom Studies 59: 63-80. 

28. Dasgupta P (1988) Trust as a commodity. In: Trust: making and breaking cooperative relations, 
D Gambetta, ed : 49-72. 

29. Kreps DM (1990) Cooperate culture and economic theory. In: Perspectives on Positive Political 
Economy (J Ah and K Shepsle, Eds) : 90-143. 

30. Berg J, Dickhaut J, McCabe K (1995) Trust, reciprocity, and social history. Games Econom Behav 
10: 122-142. 

31. Fehr E, Fischbacher U (2003) The nature of human ahruism. Nature 425: 785-791. 

32. McCabc KA, Smith VL, LePore M (2000) Intentionality detection and "mindreading" : Why does 
game form matter? Proc Natl Acad Sci USA 97: 4404-4409. 

33. McCabc KA, Rigdon ML, Smith VL (2003) Positive reciprocity and intentions in trust games. J 
Econom Behav & Organization 52: 267-275. 

34. Keser C (2003) Experimental games for the design of reputation management systems. IBM Syst 
J 42: 498-506. 

35. Basu S, Dickhaut J, Hecht G, Towry K, Waymire G (2009) Recordkeeping alters economic history 
by promoting reciprocity. Proc Natl Acad Sci USA 106: 1009-1014. 

36. Bracht J, Fcltovich N (2009) Whatever you say, your reputation precedes you: Observation and 
cheap talk in the trust game. J Public Econom 93: 1036-1044. 

37. Greif A (1993) Contract enforceability and economic institutions in early trade: the Maghribi 
traders' coalition. Amer Econ Rev 83: 525-548. 



26 



38. Grcif A (2006) Institutions and the path to the modern economy. Cambridge: Cambridge University 
Press. 

39. Diekmann A, Przepiorka W (2005) The evolution of trust and reputation: resuhs from simulation 
experiments. Third ESSA Conference : 1-7. 

40. Resnick P, Zeckliauser R, Swanson J, Lockwood K (2006) The value of reputation on ebay: A 
controlled experiment. Exp Econ 9: 79-101. 

41. Bravo G, Tamburino L (2008) The evolution of trust in non-simultaneous exchange situations. 
Rationality and Society 20: 85-113. 

42. Samuelson L, Zhang J (1992) Evolutionary stability in asymmetric games. J Econom Theory 57: 
363-391. 

43. WeibuU JW (1995) Evolutionary Game Theory. Cambridge, MA: MIT Press. 

44. Hofbauer J, Sigmund K (1998) Evolutionary Games and Population Dynamics. Cambridge, UK: 
Cambridge University Press. 

45. Gintis H (2009) Game Theory Evolving, Second Edition. Princeton, NJ: Princeton University 
Press. 

46. McNamara JM, Stephens PA, DaU SRX, Houston AI (2009) Evolution of trust and trustworthiness: 
social awareness favours personality differences. Proc R Soc B 276: 605-613. 

47. Milinski M, Semmann D, Bakker TCM, Krambeck HJ (2001) Cooperation through indirect reci- 
procity: Image scoring or standing strategy? Proc R Soc B 268: 2495-2501. 



27 



Figure captions 

Figure 1: Schematic of the trust game. 

Figure 2: Probability of Buy yl in the cooperative equihbrium in the limit ^ ^ 0. Wc set (a) = 1 and 
(b) e = 0.1. 

Figure 3: The threshold value of r above which the cooperative equilibrium exists and is stable. 

Figure 4: Boundary between the attractive basins of the cooperative and uncooperative equilibria. The 
points above the boundary are attracted to the cooperative equilibrium. We set /j, = 0.02, e = 0.1, 
r = 0.15, and 6* = 1. 

Figure 5: Relative volume of the attractive basin of the cooperative equilibrium. We set fi = 0.02 and 
e = 0.1. Initially, (a) three and (b) four buyer's strategics are distributed according to the uniform 
density. 
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